A Neural Chaos Model of Multistable Perception 



Natsuki Nagao 1 , Haruhiko Nishimura 1 and Nobuyuki Matsui 2 

1 Studies of Information Science, Hyogo University of Education, 942-1 Yashiro- 
cho, Hyogo 673-1494, Japan, e-mail: {nagao, haru}@life. hyogo-u.ac.jp 
2 Department of Computer Engineering, Himeji Institute of Technology, Himcji- 
shi, Hyogo 671-2201, Japan, e-mail: matsui@comp.eng.himeji-tech.ac.jp 

Abstract 

We present a perception model of ambiguous patterns based on the 
chaotic neural network and investigate the characteristics through com- 
puter simulations. The results induced by the chaotic activity are similar 
to those of psychophysical experiments and it is difficult for the stochastic 
activity to reproduce them in the same simple framework. Our demon- 
stration suggests functional usefulness of the chaotic activity in perceptual 
systems even at higher cognitive levels. The perceptual alternation may 
be an inherent feature built in the chaotic neuron assembly. 

Keywords: perceptual alternation, ambiguous hgure, chaos, neural network, 
stimulus-response 

1 Introduction 

Perceptual alternation phenomena of ambiguous figures have been studied for a 
long time. Figure-ground, perspective (depth) and semantic ambiguities are well 
known (As an overview, for example, see Q and ^|). Actually, when we view 
the Necker cube which is a classic example of perspective alternation, a part 
of the figure is perceived either as front or back of a cube and our perception 
switches between the two different interpretations as shown in Fig.l. In this 
circumstance the external stimulus is kept constant, but perception undergoes 
involuntary and random-like change. The measurements have been quantified 
in psychophysical experiments and it becomes evident that the times between 
such changes are approximately Gamma distributed j| ||, gj. 

Theoretical model approaches to explaining the facts have been made mainly 
from three situations based on the synergetics |, |, @, the BSB (brain-state- 
in-a-box) neural network mode l |q , p[ [L0| , and the PDP (parallel distributed 
processing) schema model jy], |l2| , fl3[ . Common to these approaches is that 
top-down designs are applied so that the model can be manipulable by a few 
parameters and upon this basis fluctuating sources are brought in. The major 
interests seem to be not in the relation between the whole function and its 
element (neuron), but in the model building at the phenomenological level. 

Until now diverse types of chaos have been confirmed at several hierarchical 
levels in the real neural systems from single cells to cortical networks (e.g. ionic 
channels, spike trains from cells, EEC) [jT4| . This suggests that artificial neu- 
ral networks based on the McCulloch-Pitts neuron model [^5) should be re- 
examined and re-developed. Chaos may play an essential role in the extended 
frame of the Hopfield neural network |l6[ ] beyond the only equilibrium point 
attractors. To make this point clear, following the model of chaotic neural 
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Figure 1: Perception of the Necker cube with its two alternative interpretations. 

network [ jl7| , the dynamic learning and retrieving features of the associative 
memory have been studied Jl8], In this paper, we present a perception 

model of ambiguous patterns based on the chaotic neural network from the 
viewpoint of bottom-up approach |2(j], aiming at the functioning of chaos in 
dynamic perceptual processes. 

2 Model and Method 

The chaotic neural network (CNN) composed of N chaotic neurons is described 
as @@ 

Xi(t+1) = /Mt+1) + Ci(*+1)) , (i) 

N t 

vi(t+i) = Y. w ^H kd f x ^- d ) . ( 2 ) 

j=l d=o 
t 

Ci(* + 1) = -a^krMt-d) -Oi , (3) 

where X% : output of neuron i{— 1 < Xi < 1), Wij : synaptic weight from neuron 
j to neuron i, Oi : threshold of neuron i, kf{k r ) : decay factor for the feed- 
back(refractorincss) (0 < kf, k r < 1), a : refractory scaling parameter, / : out- 
put function defined by f(y) = tanh(y/2e) with the steepness parameter e. 
Owing to the exponentially decaying form of the past influence, Eqs.(2) and (3) 
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can be reduced to 

N 

Tfc(t+1) = k f TJi(t) +^WyIj(t) , (4) 

3=1 

Ci(t+1) = -aXj(t)+ a , (5) 

where a is temporally constant a = — 0,(1 — fc r ). All neurons are updated in 
parallel, that is, synchronously. The network corresponds to the conventional 
discrete-time Hopficld network : 

N 

X t (t + l) = f(j2 mj Xj (t) - 0«) (6) 

3=1 

when a = fc/ = k r = (Hopfield network point (HNP)). The asymptotical sta- 
bility and chaos in discrete-time neural networks are theoretically investigated 
inRefs. H||. 

Under external stimuli, Eq.(l) is influenced as 

Xi(t + 1) = /(7?i(t + 1) + 6(t + 1) + CTi), (7) 

where {<Ji} is the effective term by external stimuli. This is a simple and unar- 
tificial incorporation of stimuli as the changes of neural active potentials. 

The two competitive interpretations are embedded in the network as minima 
of the energy map : 

E = -lj2 w v X i X l ( 8 ) 

ij 

at HNP. This is done by using a iterative perception learning rule for p(< N) 
patterns = (£f , • • • , (/j, = 1, • • • ,p; £f = + lor - 1) in the form : 
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where 7^ = 53j=i w ij£j an( ^ ^C 1 ) ^ s the unit step function. The learning 
mode is separated from the performance mode by Eq.(7). 

The conceptual picture of our model is shown in Fig. 2. Under the external 
stimulus {c7i}, chaotic activities arise on the neural network and cause the tran- 
sitions between stable states of HNP. This situation corresponds to the dynamic 
multistable perception. Note that 9(1 — 7^) turns off learning for over learned 
patterns. This will be empirically shown in the next section to have dynamics 
characteristic of a chaotic dynamical system. 

3 Simulations and Results 

To carry out computational experiments, we use the 12 x 13(iV = 156) non- 
orthogonal 10 random patterns }(y = 1, • • • , 10, ; i — N) as a set of 
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Figure 2: Conceptual picture illustrating state transitions induced by chaotic 
activity 



ambiguous figure stimuli: {<Ji} = s{£f}- s is the strength factor of stimulation. 
For each of them, two interpretation patterns 1 } and {£f 2 } are prepared by 
changing 15 white = —1) pixels to black = +1) ones which do not overlap 
between vl and vl as shown by shaded and dotted in Fig. 3, and are memorized 
following the above learning rule (p = 20). 

Figure 4 shows a time series evolution of CNN (kf = 0.5, k r = 0.8, a = 
0.34, a = 0,e= 0.015) under the stimulus {a,} = 0.7 }. Here, 

1 N 

and is called the overlap of the network state {Xi} and the interpretation 
pattern {£j U }. A switching phenomenon between {£j U } (m 11 = 1.0) and {£} 2 } 
(to 11 = 0.62) can be observed. Bursts of switching are interspersed with pro- 
longed periods during which {Xi} trembles near 

{Zi 1 } or {€i 2 }- Evaluating the 
maximum Lyapunov exponent j23] to be positive (Ai = 0.26), we find that the 
network is dynamically in chaos. In the cases Ai < 0, such switching phenomena 
do not arise. 

From the 2 x 10 5 iteration data (until t = 2 x 10 5 ) of Fig.4, we get 1257 events 
staying near one of the two interpretations, {S,} 2 }- As can be seen from Fig. 5 
magnified for t-axis, they have various persistent durations T(l) ~ T(1257) 
which seem to have a random time course by the return map in (T(n), T(n+ 1)) 
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Figure 3: Pattern states of the neural network correspond to the ambiguous 
figure and its interpretations in Fig.l. White and other pixels represent the 
states -1 and +1, respectively. 




stimulus {£}}. 
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Figure 5: Time series of the overlap with {£ 4 n } under the stimulus {£,}}, mag 
nified for t-axis. 
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Figure 6: Return map of the persistent durations staying one of the two inter- 
pretations for the data (T(l) - T(1257)) in Fig.3 (up to t = 2 x 10 5 ). 



shown in Fig. 6. From the evaluation of the autocorrelation function for T(n), 
C(k) =< T(n + k)T{n) > - < T(n + k) X T(n) > (here, <> means an 
average over time), we get —0.06 < C(fc)/C(0) < 0.06 against k = 1 ~ 100. 
This suggests successive durations T(n) are independent. The frequency of 
occurrence of T is plotted for 1257 events in Fig. 7. The distribution is well 
fitted by Gamma distribution 



G(f) = 1 e (12) 
r(n) 

with b = 0.918, n = 4.68(x 2 = 0.0033, r = 0.98), where T(n) is the Euler- 
Gamma function. T is the normalized duration T/15 and here 15 step interval 
is applied to determine the relative frequencies. 
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Figure 7: Frequency distribution of the persistent durations T(n) and the cor- 
responding Gamma distribution. 



The results arc in good agreement with the characteristics of psychophysical 
experiments [|, ^j. Similar results to the above example are obtained in the 
appropriate parameter regions where the network may induce chaotic activities 
under external stimuli. It is found that aperiodic spontaneous switching does 
not necessitate some stochastic description as in the synergetic model ^ ^| . 

These results can not be easily explained through the use of a standard 
Hopfield network with a stochastic fluctuation forcing function. We look into the 
case that the stochastic fluctuation {i^} is attached to Eq.(6) of HNP together 
with the external stimulus {<7i} : 



N 

X i (t + l) = f(j2^ijX j (t) + a i + F i (t)j , (13) 

where 

f <Fi(t) >=0 



<F i (t)F ] (t / ) >=D 2 S tt ,S l 



(14) 



Using this equation in the same framework, we examined many cases with dif- 
ferent values of the noise strength D, but couldn't find successive alternation 
phenomena. Figure 8 is a typical result in s = 0.5, D = 0.65 and is far from the 
realization of sudden perceptual changes. In such a simple scheme, the noise 
does not drive a quick motion of {Xi} for the energy barrier. In Fig. 9 the fre- 
quency of occurrence T is plotted for 1387 events obtained until t = 2 x 10 5 . 
The distribution becomes the exponential-like, not Gamma distribution. 



4 Conclusion 

We have shown that the neural chaos leads to perceptual alternations as re- 
sponses to ambiguous stimuli in the chaotic neural network. Its emergence is 
based on the simple process in a realistic bottom-up framework. In the same 
stage, similar results can not be obtained by the stochastic activity. In order to 
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Figure 9: Frequency distribution in the case of stochastic fluctuations. 
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compare the simulation results with experimental ones in a concrete form, there 
remain problems which are to analyze the relationship between the iteration 
(step) time and the visual real time, and to study the switching dependence on 
the cube's orientation or size. 

Finally, our demonstration suggests functional usefulness of the chaotic ac- 
tivity in perceptual systems even at higher cognitive levels. The perceptual 
alternation appears to be an inherent feature built in the chaotic neuron assem- 
bly. It may be interesting to study the brain with the experimental technique 
(e.g., fMRI) under the circumstance where the perceptual alternation is running. 
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